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Rarky fround Art 
The present invention relates generally to image analysis, and more 

particularly, relates to tooth shade analysis tools. 

In dentistry, there has been a shift in trend from a philosophy of driUmg and 
filling to one of prevention and cosmetics. By way of example many people today are 
choosing to have clinical procedures done to enhance their smile and appearance. Most of 
these procedures involve the modification of tooth shape, ahgmnent, and/or color. 

The use of intraoral video and/or imaging systems (hereinafter "mtraoral 
camera system") has grown rapidly m dentistry over the past few years. Such systems are 
widely utilized in "show and tell" settings, i.e., where the dentist can show and illustrate 
particular features of a patient's mouth. Tliese intraoral camera systems ate rapidly beCommg 
key for complex diagnostic and treatment plamiing. Research has indicated that 
approximately 30o/o of the practicing dentists in the age group between about 35-54 own and 
utilize intraoral camera systems. It is expected that this percentage will increase with 
increased familiarity with such systems. See Dental Procedures Report, Pgs. 22-24, February 

A necessary step in altering a patient's tooth color is to determme the shade 
of the existing tooth. For example, those persons seeking a whiter, brighter smile are still 
assessed to establish their existing tooth color so that an appropriate before and after 
comparison can be made. Shade determination is even more important for those persons 
seeking reconstructive work, since one goal of the reconstructive process is to achieve a 
natural appearance. Therefore, it is important to know the existing tooth shade so that it can 
be accurately matched with the new restoration. The dental profession utilizes standardized 
shade guides created by those companies which manufacture the reconstructive matenals. 
One well-known shade guide is the Vita™ shade guide, which includes sixteen different 
shades. Other, less popular shade guides include those guides provided by Bioform™ and 
SR-VivadentTM. 

These shade guides are utilized in a rudimentary fashion. The guide itself is a 
plastic plate with a plurality of removable color tabs that are shaped like a tooth, e.g., the 
front tooth. Typically, to assess a patient's tooth shade, a dentist removes one of the colored 
tabs and holds it up to the patient's tooth so that she can "eyeball" the closest match possible. 



understandably, there are n.any variables to this method, some of which ^^^^ 

subjectivity of the dentist making the eyeball assessment. 

once the tooth shade is determined, the information is used relative to the 

particular procedure needed. In bonding or filling a tooth, for example, the composite 
n.aterialsrequiredfortherestorationarespedfiedwithintherangeoftheshadegurde.e.g.. 

oneofsixteen shades fortheVita^range. More particularly.ifacrown, bridge or den^e. 
needed, the patient's shade must be determined and communicated correctly to the lab that 
makes the crown, bridge or denture. 

The communication of shade information between the dentist and the lab ,s 
e„,en,e,y mrportant. Often there is a breakdown or Mlure in «,U communication, resu.«n. 
in . poor shade match for flre patient. In some cases, a particular dentist utilizes an 
uncommon Shade guide, thereby leavingthelabtechnicianto eyeball and conv^t thc^^^^^^ 

mfomration to a Vita™ standard sh^e (si«e porceWn is often made fton, the V,ta« Shade 
euide) This too can result in improper shade matching. 

The process for selecting the porcelain for a particular tooth shade illustrates 
the difficulty in assessing and manufacturing the correct color match. If, for example, a 
crown of Vita™ shade A3 is desired, porcelain is built by hand with a paintbrush onto a 
„.odel of the tooth to be restored. Tlxe porcelain is built in layers on the model to achreve 
translucency and natural appearance. Each layer has a particular color and mtensxty 
associatedwithit. To generate shade A3, the technician follows a "recipe" that is g.ven by 
the manufacturer VidentxM,.equiringadifferent Shade for each layerofporcelaina^^^^^^^^ 
a doctor asks for a shade that is not a Vita™ standard shade, the technician typically seeks to 
achieve that shade by combining different porcelain shade combinations together, to mcrease 
or decrease the chroma, hue and value of the shade. 
25 To further complicate the color-matching process, some dentists are simply 

not skilled in taking and determining shade information. Tlierefore, these dentists sometunes 
send their patients directly to the lab where the technician can determine the shade 
information. Alternatively, these dentists sometimes have a technician come to thexr office, 
meither event, there are, at times, one ormorelevelsofsubjective uncertainty injected mto 

30 thecorrectmatchanddeterminationofapatient'stoothshade. Thus, there is a need for more 

improvements in this area. . fo 

to one known technique, a system operator is permitted to select an rmage of a 
single area on a patient's «.oth, which the system compares to a specifically con«,«ndmg 
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taag. processor in a shade guide. Such «h„i,ues have drawbacks such as being i..ens,ve. 

time consuming, etc. . j * 

Thus in addition to the needs discussed above, known techniques do not 
appear to desirably address limitations that exist in processing, communications, storage, 
5 and/or other capabilities with respect to hardware or software equipment used m shade 
analyzing. 

Snmniarv of tht^ Tnvention 

In accordance with the principles of the present invention, tooth shade scan 
0 systemsandmethodsareprovidedinwhichshadeinformationforarestorativeproductfora 

" patient'stoothisobtained. The system may capture image information for a patient s tooth 
andcompiletheimageinformationtoadatabaseofshadeguideinformatron. 

Software and/or hardware may be implemented that displays an image of the 
patient'stooth and displays dividers bywhich an operator can divide the tooth into regionsof 

15 interest or into regions that correspond to major tooth regions (e.g., the incisal, central, etc.). 
The dividers may be displayed over an image of a patient's tooth. The dividers may be 
xnoved under operator control to allow the operator to identify the appropriate regions for 
which corresponding information is available from a database of shade guide information. 
The dividers may, for example, be lines that are fixed in reference to each other, may be 

20 parallel lines, or may have other positional relationship to each other for dividing tooth 
regions. The operator may be given control of the shape of the dividers (e.g., the operator 
„.ay be permitted to create curves in lines used as dividers). The dividers allow the operator 
toidentifytwoormoreregionsdependingonthenumberandshapeofthelinesatthesame 

time. Imaging equipment such as an intraoral camera may be used to obtain an image of the 

25 patient'stooth. 

Once regions of interest are identified, color characteristics for those regions 

are obtained. Color characteristics such as valves for red, green, blue, intensity, and other 
characteristics may be obtained. Average values over an area, such as a major tooth region, 

may be used for the color characteristics. Other types of calculations may also be applied to 
30 identifyanumberthatisrepresentativeofacolorcharacteristic. Thus, color characteristics 
for several major regions (e.g.. only three regions) of a tooth may be obtained. 

An electronic shade guide may be provided. A database of information on 
tooth shades in a shade guide may be obtained. The database rnay contain information 
organized by tooth region. The information may be obtained using imaging equipment such 
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as that which is used for imaging a patient's tooth. The same imaging equipment may be 
used for a patient's tooth and a shade guide to avoid discrepancies in image quality or 
measurement. If desired, calibration techniques may be applied to providing matching image 
(e.g., color) characteristics between images obtained for a patient and images obtained from a 
shade guide. If desired, a database of shade guide information may be distributed to dentists 
or technicians, or may be stored centrally for analysis of patient images at a manufacturing 
site. If the database is distributed, the information maybe stored for local use by, for 

example, dentist or technicians. 

Information obtained by region for a patient's tooth may be applied to the 
database to identify tooth shades for a restorative product to be used for the patient. 
Numerical values for a limited set of color characteristics may be generated for each region 
of a patient's tooth. A corresponding set may exist in a database of shade guide information 
that was generated from a tooth shade guide. The values for the patient may be applied to the 
database to identify tooth shades for the patient by region. The region-by-region companson 
15 and the comparison of a limited set of color characteristics that are representative of a region 
whole, allows for quick and simple analysis and identification of tooth shades for a 



10 



20 



as a' 
patient. 



Brief Description of the D rawings 

Further features of the invention, its nature and various advantages will be 
more apparent from the following detailed description, taken in conjunction with the 
accompanying drawings in which like reference characters refer to like parts throughout, and 
in which: 

FIG. 1 is a functional block diagram of an illustrative tooth shade analyzing 
25 system in accordance with one embodiment of the present invention; 

FIG. 2 is a functional block diagram of a per based shade analyzing system in 
accordance with one embodiment of the present invention; 

FIG. 3 is a flow chart of illustrative steps involved in analyzing tooth shades 
using a database of region specific tooth shade information in accordance with one 
30 embodiment of the present invention; 

FIG. 4 is a flow chart of illustrative steps involved in identifying tooth shades 
for a patient's tooth in accordance with one embodiment of the present invention; 

FIG. 5 is a diagram of an illustrative graphical user interface in a shade 
analyzing system in accordance with one embodiment of the present invention; and 
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FIG. 6 is a diagram of illustrative database arxd patient tooth shade information 
in accordance with one embodiment of the present invention. 

n^toiiPd nescrir ^'"" nf Preferred Fmhodiments 

A database having discrete shade information for different major tooth regions 
allows for quicUdentification of appropriate tooth shades for a patient's too*. Id^^^^^^^^ 
niaybe based on numerical comparisonbetween values assigned to color charactensttcsof 

certain regions inapatient'stooth and color characteristics oftoo«. Shades for spe^^^^^^^^^ 
corresponding tooth regions inashadeguide.m«seoftoothregions(e.g., whole region. 

.ajor tooth region, etc.) for tooth shade identification allows for sufficiently accurate shade 
identification withoutrequiring complex and time-consuming analysis and/or companson of 

images such as, comparison of bitmap images, which is highly processor intensive. 

With reference now to FIG. 1, illustrative shade analyzing system 10 may be a 
system that is used to obtain image information(e.g., an image)ofpatient'stooth.SystemlO 

„,ay also be used to generate values for color characteristics that are sensed or detei^ined 
fromimageinformation,toidentifytoothshadebyregions.andtoperformotherrelated 

activities. Shade analyzing system 10 may include imaging equipment 12. display equipment 
14. memory/storage 16. user interface 18. communications equipment 20, processing 
equipment 22. and output device 24. 

imaging equipment 12 maybe equipment for obtaining information on 
physical and/orcolorcharacteristicsofapatient'steeth. hnaging equipment may be a digital 
camera (e.g., an intraoral camera). Examples of imaging equipment 12 may include Power 
0/00 offered by Insight of San Carlos. California, and Cygenascope offered by Cygnus 
instruments. Inc. of Goleta, California. Another example is a product named VistaCam by 
5 Air TechniquesofHicksville,New York. Such devices may be handled devices and m some 
applications may include their own software, display unit, storage, and/or communications 
capability (e.g., communications with personal computers). Such devices may be capable of 
seLng brightness, color (e.g., RGB, L*, a*, b*, etc.), hue, or chroma. Other characteristics 
of an image or portions of an image may be also be obtained if desired. 
0 Display equipment 14 may be equipment firom which an operator may view an 

i^age of a patient's tooth and to view and use shade analyzing software features. Display 
equipment 14 may be a computer monitor that is operably coupled to a computer which 
supplies display information to the monitor. Other equipment may also be used. 
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Memory/Storage 16 may be equipment that is «.ed to s»re an elec«.n.c »lmde 
guide, to ..ore sh.de analysing sof,wa,e application, o, ote ,ppUcati<»s. da^baae 
Lining Shade guide info™atio„(e.g,ce«.inco.orcha™c.eH^csot»ofl.shad.sm^ 

Shade guide by ,eg,o„)^ Values s.o^ in *. database n^y be ca«gonzed ba=«d on «K.ti, 
5 regions. Men,o,y/s,o„ge 16 maybe ahan. drive or overtype of computer sto«ge 
e,u,pment. other types of memory or storage are known to those skilled inthe a,t(e.g., 

RAM, ROM, DVD, CD, etc.). . 

User interface 1 8 may be equipment that permits an operator to mteract with 
■ shadeanalyzingsystemlO.Userinterfacel8mayincludealceyboard.amouse.avOice 

10 recognition system, etc. 

■ communications equipment 20 may be equipment that permttstnter-computer 

communications, for example, for the tiansfe, of shade information between -"P«- 
Communications equipment 20 may includeamodem. an eti,emetcard.adtg,ta,subsc„br 

line interface, a cable modem, etc. Otiter types of communications «,nipmen, are known to 

1 5 those skilled in the art. . , ^ 

P^cessing equipment 22 may be a processor and/or related circuitry that may 

be used in analyzing and/or identifying tooth shades. Processing equipment 22 may be a 
eentialprocessingunitofacomputer such asaperson^ computer that may mcludedtsp^ 

equipment 14. user interface 18. memory storage 16. communications equipment 20. and/or 
20 outpntdevice24. Processmg equipmen.22 may be part of a computer system that ,s remote 

flomalocationinwhichtoothimageinformationforapatientisobtamed. An md.v.du., 

processor or combinations of processor (e.g, remote and local) may be used in provdmg 

sufBcient processing to system 10. 

Output device 24 may be equipment such as a printer that provides an output 
2J ottextorimagesfor^stemlO. other types of output devices are taown to titose skilled m 

System 10 may include an intraon>l camera system. Examples of shade 
^lyzing systems are iUustiatively shown in U.S. Paten, No. 6,305.933 Bl . Uhm^^ in 
wo 00/25696 entitled "InteraCi.e Dental Restorative Network" pubhshed May 1 1 , 2000. 
30 whichar,her.byincorporatedbyreferenc.hereinin,heirentireties.Other«,»ivalent 

intraoral or digital cameras can be substituted if desire.. It is instead posstble to use a olor 
imaging device or spectrophotomete, if desited. to colle« tite color information ftom tite 
patienfs tooth and the reference shade guides, h, all these devices, it is prefe^ to mclu^ 
an isolation sleeve or other stray light-shielding device so Utat the most accurate .mages of 
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the color of the tooth can be obtained, ^se are shown for example in US Patent Publication 
No. 20030148243 of Kerschbaumer et al, which was filed December 24, 2002 which is 
incorporated herein by reference in its entirety. 

An example of a shade analyzing system is illustratively shown in FIG. 2. 
5 With reference now to FIG. 2. shade analyzing system 30 may include sufficient hardware 
and software for identifying shade information for a patient's tooth from a shade guide. 
System 30 may include personal computer 32 and hand-held imaging equipment 34. System 
30 may be a personal computer that is configured with sufficient communications equipment, 
' memory/storage, processing equipment, space display equipment, user interface capabilities, 
10 and/or output device capabilities, or configured with combinations thereof. System 30 may 
■ i„cludedisplayequipment,suchas,computermonitor36.Handheldimagingequipmentmay 

be imaging equipment that is used to capture shape and color information for a patient's 
tooth Anim.geofapatient'stoothmaybedisplayedonmonitor36. Information generated 
from the image may be analyzed by computer 32 to identify shades firom a shade guide that 

15 are to be used for a restorative product or service that is to be provided to a patient. 
Information that is generated from the image may be compared against a shade guide 
database to identify appropriate shades for a patent's tooth. Shade information for a current 
patient's tooth may be displayed on a user interface to allow inspection of the information by 
an operator. If desired, shade information for a current patient's tooth may be sent to a 

20 remote site for tooth shade analysis. 

The techniques that are illustratively described herein (e.g., in FIGS. 3-6) may 
be implementedusing the illustrative systems ofFIGS. 1 and 2. Other suitable platforms or 

components may also be applicable. 

Tooth shades for tooth restoration may be identified by region, rather than by 
25 pixel or by tooth (i.e., a tooth as a whole). For example, with reference now to FIG. 3. at step 
39 a database of information on tooth shades from tooth shade specimens (i.e., physical 
specimens in a shade guide) may be obtained and if desired distributed to dentists or 
technicians. THe database of information may be obtained in a way that is calibrated with 
respect to techniques used to obtain the information for patient information. For example, the 
30 same imaging equipment may be used both for the development of the database and for 
obtaining intraoral images of patients. The information in the database may be on tooth 
shades wherein the shades are associated with different categories of tooth regions (e.g., 
spatially different and/or mutually exclusive regions). Thus, for example, the database may 
have a set of color characteristics for each shade in the shade guide that is available for the 
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incisal region of a tooth. At step 40, the database may be stored locally at a dentist or 
technician's office, or at some other appropriate site for analysis. The database may include 
an electronic shade guide that is provided by a manufacturer of a restorative product, may 
include images of shade guides by tooth region, or may include information providmg 
detailed color characteristics of shade guides. Such infomiation may have been obtamed 
using the same or similar imaging equipment that is used to obtain tooth information for a 
patient or may be obtained with information to compensate for differences in imagmg 
characteristics of different imaging equipment being used. The tooth regions may be general 
tooth regions such as the cervical, incisal, and central tooth regions. 

Each numerical value that is stored in the database may be strictly associated 
* with one of the tooth regions and may represent a certain color characteristic of a tooth shade 
for that particular region. The use of values for whole regions should consume less memory 
than is used by conventional systems, should speed up the tooth shade analysis process, and 
has been found to provide desired levels of accuracy. 
5 At step 44, patient information is applied to the database to identity tooth 

shade information for a patient, ^formation firom the database may be compared with 
information gathered from different regions of a patient's tooth to identify appropriate shades 
to be used for the different regions of the patient's tooth. The comparison may involve a 

comparison of numerical values. 

20 Control over identifying regions of interest of a patient's tooth for which 

corresponding information exists in the database may be under an operator's control. For 
example, with reference now to FIG. 4, an operator may obtain image information of 
patient's tooth using imaging equipment such as those illustratively mentioned above. At 
step 48, an operator may be given control over how the image information will be divided 

25 into different categories of regions for use in the shade analysis process. 

An operator may be given control to select the regions (e.g., three regions at 

approximately the same time (e.g., at the same time). 

For example, an image showing the patient's tooth may be displayed on 
display equipment (e.g., display equipment HofFIG. 1). Two or more lines may be 
displayed over the image. The lines may be parallel lines and/or lines that are fixed m 
distance in relation to each other. The position of the lines in the image may be under 
operator control to allow the operator to selectively identify the different categories of 
regions (e.g.. incisal, central, and cervical). The lines should have characteristics that are 
sufficient to allow an operator to selectively identify (e.g.. simultaneously identify) the 
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categories of regions (e.g., only three categories) on the patient's tooth for which database 
information exists. If desired the operator may be given control over the shape of the hnes 
(e.g., to curve the line at certain points) to select appropriate divisions more accurately. 

While this method can be used to identify any number of regions on the tooth, 
5 it has been found that the three regions mentioned above are the most preferred. These areas 
have different shapes and provide different functions to the tooth so that they have slightly 
different colors for those reasons. Also, it is of greater importance to color match more 
accurately the patient's teeth that are the most visible to others. These are basically the front 
four teeth on the top and bottom of the patient's jaws. The accurate matching of color for a 
10. rear molar is much less critical since it is not readily viewed by others. In those cases, a 
single color for the entire tooth based on an average of the regions is often sufficient. 

At step 50, certain color characteristics for the different categories of regions 
(selectively identified by the operator) may be generated based on the image information and 
based on how the user divided the image information (e.g., captured from the image based on 
where two parallel lines dividing the patient's tooth into the incisal, central, and cervical 
regions were placed). The color characteristics may for example be the Red, Green, and Blue 
(RGB) characteristics of each region. 

At step 52, additional color characteristics may be generated from the color 
characteristics that were generated at step 50. For example, one or more algorithms may be 
applied to RGB values to obtain additional color characteristics such as the CLE. L*. a*. and 
b* values. CLE. stands for Commission Internationale de L'Eclairage, which is an 
international body that sets color measurement standards. Algorithms for converting RGB 
values to L* (brightness), a* (measure of Red-Green), and b* (measure of Blue- Yellow) are 

known to those skilled in the art. 

At step 54, tooth shades are identified by region based on information in a 
database of tooth shade information (e.g.. a database such as that described in connection 
with FIG. 3) and based on the color characteristics that are generated. A tooth shade for a 
region of a patient's tooth may be identified by comparing some or all of the color 
characteristics that were generated for that region of the patient's tooth with corresponding 
color characteristics for tooth shades in the database that are associated with that same region 

(e.g.. regions that spatially correspond). 

The process may be repeated and the shade information may be communicated 
to a manufacturing site for production of appropriate restorative products. 
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As mentioned above, image information may be divided using two lines (e.g., 
two parallel lines). An example of a technique for implementing processes described herein 
is illustratively shown in FIG. 5. Other techniques may also be implemented if desired. With 
reference now to FIG. 5, image 60 is an intraoral image of a patient's month that may be 
displayed on display equipment of a shade analyzing system. Image 60 may be displayed 
within a software window that may include software tools that the operator may select for use 
in the tooth shade analysis process. The object in image 60 that is currently of interest to the 
operator may be tooth 62. Lines 64 may be displayed over image 60. Lines 64 may be used 
to tooth 62 into three regions. The three regions may the incisal, central, and cervical regions 
of the tooth. Movement and location of the lines 64 may be under operator control to allow 
the operator to selectively identify where the desired regions are located on the patient's tooth 
62. An operator may be given control over both horizontal and vertical movement of lines 
64. The distance between lines 64 may be a fixed distance or may be a distance that is also 
under the control of the operator. If desired, the shape of lines 64 (e.g., curvature) may also 
be under operator control. Once the operator has moved lines 64 to a desired location, the 
operator may make a selection to indicate to the shade analyzing system that the lines are in a 
location that divides tooth 62 into regions for which a database of tooth shade information 
exists. In response, certain color characteristics for the regions may be captured from image 
60 to generate discrete numerical values for the color characteristics for each region as a 
whole (e.g., RGB average values for each region). Additional color characteristics may also 
be generated based on the color characteristics that have already been generated (e.g., L*, b*, 
and a*). The additional color characteristics may also be generated for each region as a 
whole (e.g., average values for L*, b*, and a* for each region). 

Color characteristic values that are generated for the tooth from image 
information or sensed by imaging equipment may provide a discrete set of values that can be 
easily and quickly compared with information in the tooth shade database to identify 
appropriate tooth shades for each region of the patient's tooth. For example, with reference 
now to FIG. 6, table 70 is a table that illustratively shows values that were generated for the 
incisal, central and cervical regions of a patient's tooth. The values that are shown in the 
table were randomly inserted and are not meant to represent actual values. The values that 
are generated for the regions of interest are RGB values and L*, a*, and b"* values. Other 
major regions of interest as appropriate may also be used for tooth shade analysis. 

Table 72 is representative of a tooth shade database. Table 72 is shown to 
include values for certain color characteristics (e.g., average value for RGB and L*, b*, and 
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a* for a region). Information in Table 72 is divided by association witii different categories 
such as different tooth regions of interest, e.g.. the incisal, centtal, and cervials (as shown). 
For each category, there exists a range of tooth shades and values for color characteristics for 
each of the tooth shades. The tooth shades correspond to shades in a shade guide and as 
mentioned above, the values for the color characteristics may have been captiired firom the 
shade guide. 

Values from table 70 may be applied to table 72 to identify appropriate shades 
for the regions of interest for the current patient's tooth. If desired, some or all of tiie color 
characteristics (e.g.. RGB, L*. b*, a*, etc.) may be used in the analysis. Various algorithms 
for determining shades may be used. Algorithms such as linear fit, least squared fit, or other 
algorithm for comparing multiple values may be used. Also, if the color characteristics for a 
patient fall between two shades, some of interpolation may be applied to the two shades to 
produce an additional shade for the patient's tooth that suitably fits tiie generated color 

characteristics for that patient. 

The value for the color characteristics is primarily discussed herein as average 
value. However, techniques other averaging may also be sued to assign a certain 

characteristic to a region. 

It is to be understood that the invention is not to be limited to the exact 
configuration as illustrated and described herein. Accordingly, all expedient modifications 
readily attainable by one of ordinary skill in the art from the disclosure set forth herein, or by 
routine experimentation there from, are deemed to be within.the spirit and scope of the 
invention as defined by the appended claims. 
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